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REMARKS  ABOUT  RANDOM  SAMPLING  FROM  BETA  AND  GAMMA  DISTRIBUTIONS 

by  Bennett  Fox 

Methods  for  generating  random  numbers  from  beta  and  gamma  distributions 
exist  (see  the  appendix),  but  the  time  required  to  generate  them  is  an  order 
of  magnitude  larger  than  that  required  when  the  parameters  are  integers. 

From  a  gamma  distribution  with  integral  shape  parameter,  random  numbers 
can  readily  be  generated  by  well-known  methods.  For  the  beta  distribution 
with  integral  parameters  (a,b)  ,  an  efficient  method  was  pointed  out  by  the 
author  in  [1]  and  independently  noted  later  in  [2].  The  technique  is  to  take 
the  ath  smallest  of  a  +  b  -  1  uniform  random  numbers. 

Rather  than  generate  random  numbers  from  a  gamma  distribution  with  non¬ 
integral  shape  parameter,  we  suggest  that  one  look  to  the  Weibull  family,  from 
which  one  can  usually  get  a  equally  good  fit  to  data.  A  great  many  observa¬ 
tions  are  required  to  discriminate  between  the  Weibull  and  gamma  families. 
Relative  to  known  methods  (see,  e.g.,  the  appendix)  for  generating  random  num¬ 
bers  from  a  gamma  distribution  with  nonintegral  shape  parameter,  a  random  num- 

-Xxk 

ber  w  from  the  Weibull  distribution  with  c.d.f.  1  -  e  can  quickly  be 

1  1/k 

obtained  by  setting  w  ■  (-  y  log  u)  ,  where  u  is  a  uniform  random  number. 

Now  we  dispose  of  the  case  of  a  beta  distribution  with  nonintegral  para¬ 
meters.  There  are  two  natural  approximate  methods.  One  is  to  use  a  beta  dis¬ 
tribution  with  integral  parameters  close  (with  respect  to  some  norm)  to  the 
original. 

As  an  example  of  integral  approximation,  consider  a  Bernoulli  process 
(e.g.,  coin  flips)  with  parameter  p  assumed  to  have  a  beta  prior  distribu¬ 
tion  g(a,b).  More  explicitly,  suppose  that  p  has  a  fixed  (but  unknown) 
value  Pq  and  that  8(a,b)  measures  our  uncertainty  about  its  location.  One 


k 
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way  to  simulate  the  process  (not  necessarily  the  most  efficient)  is  to  generate 
a  random  from  0(a,b)  ,  perform  a  Bernoulli  trial  with  this  random  number  as 
parameter,  and  repeat.  Suppose  that  we  wish  to  choose  appropriate  values  for 
a  and  b  from  empirical  data.  With  k  successes  (e.g.,  heads  in  coin  flips) 
in  n  trials,  the  method  of  matching  moments  yields 

A 

a  It 

A  A 

a  +  b  n 


a  b 


A  A  A  A  A 

(a  +  b)  (a  +  b  +  1) 


(k/n)  [1  -  (k/n)] 
n 


If  n  is  large,  we  have  the  Immediate  (near)  Integral  solution. 

A 

a  <=?  k 

A 

b  2*  n-k  , 

which  coincide  with  the  parameters  of  the  posterior  distribution  starting  with 
a  uniform  prior  distribution. 

The  second  method  is  based  on  a  step  function  approximation  to  the  beta 

density  function  with,  say,  n  steps.  Let  the  height  and  width  of  the  i-th 

n  n 

step  be  h.  and  w.  ,  respectively.  Assume  that  E  h.w.  ■  I  w  ■  1  .  Gener- 

l  1  1  1  1  1  1 

k-1  k 

ate  uniform  random  numbers  u  and  u'  ,  and  suppose  that  E  h.w.  <_  u  <  E  h.w 

1  i  l  -  !  1  1 

k-1 

Then  u'w,  +  E  w.  is  a  random  number  from  the  approximating  distribution.  A 

X  i  i 

similar  technique  works  for  trapezoidal  approximation. 

A  case  where  sampling  from  an  approximating  distribution  might  be  appro¬ 
priate  is  the  simulation  of  project  networks  (see,  e.g.,  [ 3 j )  where  the  job 
durations  are  often  assumed  to  have  beta  distributions,  except  possibly  for  a 
change  of  scale  and  translation.  Presumably,  these  distributions  represent  the 


a  priori  beliefs  of  the  planner ,  who  would  seldom  be  willing  to  claim  that  he 
was  sure  that  a  job  duration  had  exactly  a  particular  beta  distribution.  Hence, 
it  is  reasonable  to  sample  from  an  approximating  distribution,  especially  when 
considerable  computer  time  can  be  saved  by  doing  so.  As  was  pointed  out  in  [3], 
it  may  be  appropriate  to  use  a  triangular  distribution. 
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AP PEND IX 


Exact  schemes  for  sampling  from  beta  and  gamma  distributions  with  arbi¬ 
trary  parameters  have  been  proposed  [2].  For  convenient  reference,  we  give 
them  here.  The  proofs  are  straightforward;  for  details,  see  [2]. 

The  sampling  algorithm  for  the  beta  distribution  $(a,b)  is 

1.  i  -  1. 

2.  Generate  a  uniform  random  number  u^  and 

3.  Generate  a  uniform  random  number  u^+1  and 

4.  If  x  4-  y  <_  1  ,  go  to  6;  otherwise,  go  to  5. 

5.  i  -►  i  +  2  ;  go  to  2. 

6.  Done.  x/(x  +  y)  is  a  random  number  from  6(a,b)  . 

An  (Incomplete)  measure  of  efficiency  is  1/E  ,  where  E  is  the  expected 
number  of  uniform  random  numbers  generated.  This  measure  does  not  take  account 
of  all  the  calculations  required.  For  the  above  algorithm, 

E  ■  ^\v  .  When  a  ■  b  ■  3  ,  E  •  40  . 

a  b  B(a,b) 

If  In  Step  6  x/(x  +  y)  is  replaced  by  x  ,  we  get  a  random  number  from 
8(a,  b  +  1)  .  Hence  for  b  >  1  this  gives  a  slightly  faster  way  of  getting 
a  random  number  from  6(a,b). 

For  the  gamma  distribution  with  nonintegral  shape  parameter  c  and  scale 
parameter  X  ,  the  algorithm  is 

[c] 

1.  Set  z  ■  -log  II  u.  ,  the  u.  are  uniform  random  numbers. 

1  1  1 

2.  Generate  a  random  number  w  from  6(c '-  [c],  1  -  c  +  [c ] ) ,  using  the 


1/a 

set  x  ■  u^ 


set  y 


1/b 

ui+l  ‘ 


preceding  algorithm. 


? 
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3.  Generate  a  uniform  random  number  u  and  set  y 

4.  (z  +  wy)/X  is  the  desired  random  number. 

Letting  k  ■  c  -  [c]  ,  we  have 


E  -  [c]  +  1  + 


k(l  -  k)  B(k,  1  -  k) 


•  [c]  +  1  + 


2  sin  Tik 

7rk(l  -  k) 


js  [c]  +  3  . 


*  -log  u  . 


IfctJ 
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HANSON'S  DUAL  PROGRAM 


by  R.N.  Kaul 


1.  Introduction 

In  [1]  Hanson  studies  a  pair  of  non-linear  Problems  I  and  II  such  that 
existence  of  optimal  solution  to  one  of  them  Implies  the  existence  of  optimal 
solution  to  the  other  and  the  two  extrema  are  equal.  While  the  result  that 
the  existence  of  an  optimal  solution  to  Problem  I  insuring  an  optimal  solution 
to  Problem  II  is  straightforward  and  has  also  been  proved  by  Wolfe  [2];  the 
converse  problem,  namely,  the  existence  of  optimal  solution  to  Problem  II  im¬ 
plying  an  optimal  solution  for  Problem  I  makes  use  of  some  assumptions.  The 
aim  of  this  note  is  to  give  an  auxiliary  condition  similar  to  the  one  consi¬ 
dered  in  [3]  which  ensures  the  existence  of  optimal  solution  to  Problem  I  as 
well  as  the  equality  of  the  objective  functions  once  an  optimal  solution  to 
Problem  I  exists.  We,  of  course,  assume  that  the  constraint  qualifications  of 
Kuhn  and  Tucker  [4]  are  satisfied. 

2.  Dual  Programs 


Probleta  I: 

Minimize  $(x) 

Subject  to  f(x)  _>  0  — 

(1) 

x  >_  0  — 

(2) 

Problem  II: 

T 

Maximize  G(x,y)  =  F(x,y)  -x  ?xF(x,y) 

Subject  to  V  F(x,y)  >_  0  — 

A 

(3) 

y  >_  0 - 

T 

where  F(x,y)  -  4»(x)  -y  f(x) 

(4) 
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Here  $(x)  Is  a  convex  differentiable  function  of  the  vector  x  ,  f(x)  is 
a  concave  differentiable  function  of  the  n-dimensional  vector  x  and 
vx  -  (3/Sxj .  S/3  . 

i 

J 

Let  xq  be  the  optimal  solution  for  Problem  I.  Then  according  to  the 
conditions  of  Kuhn  and  Tucker  [4] ,  there  exists  a  vector  yQ  such  that 

y0  1  0  (5) 

[7F(x,y)]  1  0  (6) 

x  Vyo 

#(*„)  -  0  (7) 

xT[VF(x,y)]  -  0  (8) 

o  x  ,y 

x  o,Jo 


For  any  feasible  solution  (x,y)  of  Problem  II,  we  have  using  (7)  and  (8) 

G<Vy0)  "  G<x»y)  ■ 


*(x  )  -  $(x)  +  yTf(x)  +  xTV  $(x)  -  xTV  (yTf(x))  .  (9) 

X  X 

Also 

t(x  )  -  4>(x)  >  (x  -  x)TV  4>(x)  (10) 

°  “  0  x 

because  $(x)  is  convex 
and 

yTf(x)  >  yT[f(xo)  -  (xq  -  x)TV  f(x)]  (11) 

x 


because  f(x)  is  concave 

Therefore  making  use  of  the  above  inequalities  together  with  (1),  (2),  (3), 
(4)  and  (8)  the  relation  (9)  yields 


G(Vy0>  “  G<xty)  >  o 


which  establishes  that  (x  ,y  )  is  an  optimal  solution  to  Problem  II. 

o  o 

The  above  result  has  already  been  proved  in  [1]  and  [2]. 

The  main  result  that  shall  be  proved  is  the  following: 

If  (%iy)  is  an  optimal  solution  to  Problem  II  and  if  the  following 
auxiliary  condition  ie  satisfied ,  then  there  exists  an  optimal  solution  to 
Problem  I  and  the  optimum  of  the  objectives  of  the  two  problems  are  equal. 
Condition  A:  The  matrix  V  F(xty)  is  non-singular  at  (x,y). 

Assume  now  that  we  have  an  optimal  solution  (x,y)  to  Problem  II.  Apply¬ 
ing  again  the  conditions  of  Kuhn  Tucker  the  following  holds. 

There  exists  a  vector  X  _>  0  such  that 

X  TvxxF<x»y)  +  ?xG(x,y)  -  0 

X  TVyxF(x,y)  +  VyG(x,y)  <  0 

X  TV  F(x,y)  -  0 

[X~TV  F(x,y)  +  V  G(x,y)]y  -  0 
yx  y 

All  the  derivatives  in  the  above  relations  are  evaluated  at  (x,y)  .  These 
reduce  to 

(X1  -  ?)  V  F(x,y)  -  0  (12) 

(X1  -  TT )  V  f (x)  -  f (x)  £  0  (13) 

X 

'xT[VxF(x,y)]  -  0  (14) 

[(X1  -  ?)  V  f(x)  -  f (x) ]y  -  0 


(15) 
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From  condition  A  and  (12)  It  follows  that 


Thus  relations  (13),  (14),  (15)  imply  respectively  (1),  (8)  and  (7).  We  know 
by  assumption  that  relations  (5)  and  (6)  are  true.  This  shows  that  the  neces¬ 
sary  conditions  for  the  existence  of  optimal  solution  to  Problem  I  are  satis¬ 
fied. 

But  since  4(x)  is  convex  and  f(x)  concave,  these  necessary  conditions 
are  also  sufficient  [5].  Hence  the  result. 
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A  SHORT  PROOF  OF  HU'S  ASSEMBLY  LINE  THEOREM 
by  Lars-Chr.  Lorentzen 


1  Introduction: 

T.C.  Hu  has  In  [1]  studied  the  situation  where  n  jobs,  taking  the  same 
amount  of  time  have  to  be  done  by  m  men.  The  jobs  are  partially  ordered 
where  Job  A  dominates  job  B  means  that  job  A  has  to  be  done  before  job  B.  He 
gives  a  procedure  for  finding  an  assignment  of  men  to  jobs  which  minimizes 
the  time  requ  red  to  complete  all  the  jobs  in  the  case  where  the  partially 
ordered  set  of  jobs  forms  a  forest  with  every  tree  having  a  unique  minimal 
job.  The  purpose  of  this  note  is  to  give  a  shorter  proof  of  the  fact  that 
the  resulting  assignment  is  optimal. 

2  Statement  of  the  Procedure: 

First  we  label  all  the  jobs  in  the  forest  in  steps.  Starting  with  i=l 
we,  in  the  i-th  step,  give  all  the  minimal  jobs  in  the  subforest  of  unlabeled 
jobs  the  label  1  . 

Then  we  assign  men  to  jobs: 

Starting  with  1  ■  1  we  in  the  i-th  time  period  assign  maximal  jobs  in  the 
subforest  of  incompleted  jobs  to  as  many  of  our  m  men  as  possible.  If 
there  are  more  than  m  maximal  Jobs  we  give  preference  to  the  jobs  with  high¬ 
est  labels. 


Example: 


Observe  that  the  procedure  need  not  specif/  the  assignment  uniquely. 

3  Reversed  Procedure: 

We  shall  now  describe  a  reversed  procedure.  First  we  label  every  job 
with  the  "distance"  from  the  "farthest"  maximal  job  which  dominates  it. 

Then  we  assign  men  to  jobs  backwards  In  time: 

Starting  with  1-1  we  in  the  i-th  period  from  finishing  time  assign 
minimal  jobs  in  the  subforest  of  uncompleted  jobs  to  as  many  of  our  m  men 
as  possible.  If  there  are  more  than  ra  minimal  jobs  we  give  preference  to 
the  jobs  with  highest  labels. 

Our  example: 


* 


4  Proof  of  the  fact  that  the  two  procedures  lead  to  optimal  assignments: 

First  we  consider  the  reversed  procedure: 

Suppose  the  result  Is  proved  for  any  forest  of  n  -  1  or  less  jobs, 
and  let  a  forest  of  n  jobs  be  given.  If  the  forest  has  <_  m  minimal  jobs, 
an  optimal  last  step  is  obviously  to  complete  all  the  minimal  jobs  and  we  are 
back  to  the  case  with  fewer  than  n  jobs.  Let  us  assume  that  the  forest  has 


>  m  minimal  jobs.  Let  a  possible  set  of  jobs  to  be  done  in  the  last  time 


period  following  the  reversed  procedure  be  where  the  a's 

represent  the  labels,  but  assume  this  is  not  an  optimal  way  of  finishing. 
Let  it  be  optimal  to  complete  the  jobs  ^l)  *  *  *  ^*ni-r) 

in  the  last  time  period.  We  now  know  that  it  is  optimal  to  continue  accor¬ 


ding  to  the  procedure  because  of  the  induction  hypothesis.  In  the  next  to 
last  period  we  therefore  need  not  complete  any  job  dominating 
because  if  >  1  for  i  ■  l,...,n  we  can  find  m  minimal  jobs 


“i  "i 


o  -  1 
m-r 


m-r+1 


with  labels  >.  6^  -  1,  i  ■  l,...,r. 
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lf  some  ai  ■  1  there  is  no  job  dominating  •  •  •  (^rj% 


Assume  an 


optimal  next  to  last  step  is  to  complete  the  jobs 


m-r+1 


a.  -  1  /  ...  (  a  -  1 
1  s  _ ' 


where  s  +  t  <  r  . 


©. 


minimal  jobs  in 
the  original  forest 


But  these  two 


steps  are  equivalent  to  completing  the  jobs  (\J  *  *  *  (^nT) 


in  the  last  time  period  and  the  jobs 

(5)  *  '  ’  (al  ’  *  *  (j /  (h)  *  *  *  ^t) 

in  the  next  to  last  time  period. 

This  completes  the  proof  for  the  reversed  procedure. 

We  now  turn  to  the  original  procedure.  Assume  that  the  result  is  proved 
for  a  forest  of  n  -  1  or  less  jobs  and  we  are  given  a  forest  of  n  jobs. 
Suppose  it  would  be  compatible  with  the  procedure  to  start  doing  jobs 

is  easily  seen  that  if  we  perform  the  reversed  procedure 
giving  preference  to  jobs  with  lowest  "forward"  labels  when  this  occurs,  we 
can  secure  that  in  the  first  time  period  a  subset  of  the  jobs 
is  done.  The  result  therefore  follows  by  induction. 


5  The  problem  of  generalization: 

a)  The  following  example  shows  that  the  method  does  not  work  if  the  trees  do 
not  have  unique  minimal  jobs: 
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b)  It  Is  easily  seen  that  our  proof  is  valid  if  the  number  of  available  men 
is  increasing  with  time.  The  following  example  shows  however  that  when  we 
have  the  more  realistic  situation  where  the  number  of  men  m(t)  is  decreasing 
in  time  the  procedure  does  not  work: 


m(t) 


2 

4 


3 

1 


4  5 
1  1 


eee 


•  •  • 


6  Reference:  T.C.  Hu,  "Parallel  Sequencing  and  Assembly  Line  Problems," 

Operations  Research  9,  6,  1962. 


PROOF  OF  A  THEOREM  FROM  THE  THEORY  OF  COMPLEMENTARY 
SOLUTIONS  OF  LINEAR  SYSTEMS 

by  Lars-Chr.  Lorentzen 


Given  the  linear  system 


w  ■  Mz  +  q 

and  any  complementary  canonical  equivalent 

w  «  Mz  +  q  (See  [1]) 

The  objective  of  this  note  is  to  give  a  proof  of  the  following  theorem  stated 
in  [1]  p.  7: 

Theorem:  If  M  has  nonnegative  (positive)  principal  determinants,  so  has  M. 
Lemma  l:  If  M  has  nonnegative  (positive)  principal  determinants,  then 
M*(S)  *  £M  +  (1  -  01  has  positive  principal  determinants  for  0  <_  £  <  1 
(0  <_  £  <_  1  in  the  positive  case). 

Proof:  Let  N  be  a  principal  minor  of  M  of  order  p  .  The  .  by  expansion 
we  see  that 


det  N*(0  -  det  £N  +  (1  -  £)P  +  (1  -  C)1  Z  det  £P  (p_1)  >  0 

i-1  4  J 


where  P 


J 


(p-i) 


J 


is  the  j-th  principal  minor  of  the  (p  -  i)-th  order. 


Lemma  2:  If  M  has  nonvanishing  principal  determinants,  so  has  M  . 

Proof:  Without  loss  of  generality  we  may  assume  that  M  results  from  M  by 
pivoting  on  m^  (j*  0  by  hypothesis)  and  interchanging  z^  and  w^  .  We 
distinguish  between  two  types  of  principal  minors:  those  which  contain  m^ 
and  those  which  do  not.  It  suffices  to  consider  M^  ■  [m^]  i»j  ■  1»***»P 
and  M2  ■  [m..]  i,j  -  2,...,p  .  The  rank  of  Mj  does  not  change  by  the  inter- 
change  because  [1,  0,  ...»  0]T  is  independent  of  M^,...,MP  where  MJ  is 
the  i-th  column  of  M  .  (Indeed  if  we  had  dependence,  M^ , . . . ,  Mp  would  have 

•J 

been  dependent,  which  is  a  contradiction  since  M2  is  nonsingular.) 
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Nelther  does  the  pivot  change  the  rank  of  .  As  far  as  M2  Is  con¬ 
cerned  we  see  at  once  that  det  M-  ■  —  det  M,  j  0  as  the  Interchange  of  w, 

l  m^  1  1 

and  z^  does  not  affect  this  minor. 

Lemma  3:  The  principal  determinants  of  M*(£)  are  continuous  functions  of  £ 
for  0  <_  C  <_  1  . 

Proof:  The  transition  from  M*(£)  to  M*(£)  corresponds  to  premultiplying 
w  ■  Mz  +  q  by  a  block  pivot  matrix  of  the  form 


-A"1^)  ,  0 


C(0A"1(0  . 

M*(0  as 


where  we  have  written 


A(5)  ,  BU) 

C(0  ,  D(0 


Thus  the  only  denominator  in  the  expression  for  M*(S)  is 

det  AU)  -  det [CA  +  (1-5)U  1  det  CA  +  (1-0*  1  1/2  min  (l,det  A) 


The  proof  of  the  theorem  now  goes  like  this: 

Let  N*(S)  be  a  principal  minor  in  M*(£) 

Then  det  N*(0  +  0  for  0  £  £  <  1  (0  £  5  <.  1  in  the  positive  case). 

N*(£)  is  continuous  for  0  <_  £  <_  1  ,  and  N*(0)  ■  1  . 


Dantzlg  has  proved  the  following  which  can  replace  lemma  2: 

Lemma  2':  If  M  has  positive  principal  determinants,  so  has  M  . 

Proof:  As  earlier  we  assume  that  M  results  from  M  by  pivoting  on  m^ 
and  then  interchanging  z 1  and  w^^  ,  and  we  consider  and  M2  . 
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Mult  ip  lying  row  1  by  m^  and  subtracting  from  row  i  (i  -  2,...,p)  makes 
it  clear  that  det  M^  >  0  . 

Furthermore  we  have 


Multiplying  row  1  by  m^  and  adding  to  row  i  makes  it  clear  that  det  M^  >  0  . 

The  type  of  argument  used  in  the  proof  of  lemmas  1  and  3  can  also  be  applied 
to  proving  the  following 

Theorem:  If  M  is  positive  semidefinite  (definite),  then  det  M  :>  0  (>  0)  . 

Proof:  £M  +  (1  -  5)1  is  positive  definite  for  0  <_  5  <  1  (0  <  5  <  1  in 

the  definite  case)  and  has  therefore  nonvanishing  determinant.  Since  it  is 
a  continuous  function  of  5  In  [0,1]  with  value  1  for  5  ■  0  the  theorem 


follows. 
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NETWORKS  AND  ASSEMBLY  LINE  BALANCING 


by 

Shishir  Kumar  Mukherjee 


The  assembly  line  balancing  problem  belongs  to  the  class  of  combinational 
optimization  problems  theoretically  solvable  by  complete  enumeration,  but 
which  has  defied  solution  by  efficient  algorithms.  In  a  line  balancing  problem, 
a  finite  set  of  work  elements  are  given,  each  having  a  fixed  processing  time. 
The  set  is  partially  ordered  and  a  set  of  precedence  relations  are  given  which 
specify  the  permissible  ordering  of  the  elements.  The  main  problem  of  line 
balancing  is  to  assign  the  elements  to  an  ordered  sequence  of  stations  such 
that  the  precedence  relations  are  not  violated  and  the  sum  of  the  delay  time 
at  each  station  is  minimized. 

Formally  we  follow  Gutjahr  anc  Nemhauser  [2]* to  define  the  problem  as 
follows:  Given  a  finite  set  B,  a  partial  order  p  defined  on  B,  a  positive 
real  valued  function  t  defined  on  B,  and  a  number  c,  find  a  collection  of 
subsets  of  B,  (A^,...,An>,  satisfying  the  following  five  conditions: 


,n 


u>  JT  k 


B 


(2)  A^ri  Aj  »0  (the  empty  set),  i  ^  j 

(3)  t  (A^)  ■  I  t  (x)  ^  c,  i  *  l,...,n 

xeA^ 

(A)  If  xpy  (x  precedes  y)  and  xeA^  ,  yeA^  ,  then  i  <,  j 
(5)  (c  -  t(Ai))  is  minimized. 

The  set  B  is  the  set  of  the  work  elements  (x,y,...)  and  the  partial 
order  p  is  the  set  of  precedence  relations;  t  represents  the  required  time 
and  c  is  the  cycle  time.  Sets  A±  satisfying  1-4  are  feasible  assign¬ 
ments  to  work  stations  which  are  usually  too  many,  and  those  satisfying  all 
five  conditions  are  an  assignment  of  elements  to  the  n-stations  which  minimize 


♦Numbers  in  parentheses  correspond  to  references  at  the  end  of  this  paper, 
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the  total  delay  time  for  any  n  . 

The  literature  on  assembly  line  balancing  contains  a  number  of  methods 
and  a  good  summary  of  some  of  the  earlier  methods  may  be  found  in  Kilbridge 
and  Wester  [7].  Salveson  [12]  authored  the  first  published  paper  on  assembly 
line  balancing  in  1955.  Jackson  [6]  presents  an  algorithm  for  symmetrically 
enumerating  and  evaluating  possible  solutions.  Hu  [5]  solves  a  related  pro¬ 
blem  where  each  work  element  has  equal  time  requirement.  In  this  paper  a 
heuristic  method  and  two  methods  on  finding  the  shortest  route  in  a  network 
will  be  presented.  The  effect  of  variation  of  processing  times  was  studied 
by  Mukherjee  [10]  and  recently  by  Moodie  and  Young  [9].  Held,  Karp  and 
Shareshian  [3]  have  given  a  dynamic  programming  solution  to  this  problem. 

I.  PRECEDENCE  GRAPHS 

Precedence  graphs  state  the  precedence  relations  between  work  elements 
due  to  technological  restrictions  or  restrictions  due  to  fixed  facilities  or 
positions  of  operators.  In  a  precedence  graph  the  work  elements  are  repre¬ 
sented  by  nodes.  The  nodes  are  connected  by  directed  arcs  showing  the  prece¬ 
dence  relations  except  that  arcs  are  not  drawn  where  trasitivity  implies  the 
precedence.  The  same  relations  may  be  expressed  in  a  matrix  form  as  a  pre¬ 
cedence  matrix  of  1,-1  and  0's. 

Foulkes  [1]  discusses  the  related  assembly  scheduling  problem  and  uses 
a  mixed  graph  to  represent  precedence  relations.  The  basic  concept  of  par¬ 
titioning  the  nodes  of  a  graph  into  a  set  of  equivalence  classes  is  used  to 
enumerate  paths,  "x  and  y  belong  to  the  same  equivalence  class  if  it  is  pos¬ 
sible  to  trace  a  directed  route  from  x  to  y  and  back  again."  This  definition 
clearly  means  that  an  equivalence  class  is  represented  by  a  directed  cycle 
in  the  graph.  Since  it  is  impossible  to  have  a  directed  cycle  in  the  prece¬ 
dence  braph  of  a  line  balancing  problem  (as  none  of  the  jobs  around  the  cycle 
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could  ever  be  started)  and  the  presence  of  one  indicates  inconsistency  of 
precedence  relations,  the  method  suggested  by  Foulkes  is  irrelevant  and  wrong 
as  far  as  assembly  line  schedules  are  concerned. 

II.  A  HEURISTIC  METHOD 

Mukherjee  and  Basu  [11]  have  modified  and  simplified  Helgeson  and  Birnie's 
[4]  computerized  routine  to  solve  large-scale  industrial  problems  having  100 
or  more  work  elements  by  hand  computation.  In  Phase  1  of  this  method  the  work 
elements  are  ranked  in  decreasing  order  of  positional  weights.  Helgeson  and 
Birnie  define  the  positional  weight  of  r.  work  unit  as  the  sum  of  its  own  pro¬ 
cessing  time  and  of  all  other  work  elements  which  must  follow  it.  Mukherjee 
and  Basu  define  positional  weight  of  a  work  element  as  simply  the  number  of 
work  elements  following  it.  In  case  of  a  tie  the  work  unit  with  a  higher  pro¬ 
cessing  time  is  given  a  higher  rank. 

In  Phase  2,  */ork  units  are  actually  assigned  to  work  stations  and  balance 
delay  is  computed  from  which  best  balance  for  each  value  of  n  is  determined. 

nc  -  I  t 

Balance  delay,  d  * - — -  x  100  per  cent 

For  any  fixed  n  ,  the  computation  starts  with  the  ideal  value  of  cycle  time. 
Work  elements  are  assigned  in  decreasing  order  of  the  precedence  requirements 
in  the  first  station  as  long  as  it  is  possible  to  do  so.  To  fill  up  the  un¬ 
assigned  time  a  following  element  is  assigned  if  its  predecessors  have  all  been 
previously  assigned.  When  this  is  no  longer  possible  assignment  starts  in  2nd 
station  in  the  same  order.  If  it  is  possible  to  assign  all  work  elements  in 
n  stations,  the  ideal  balance  is  obtained.  Otherwise  c  is  increased  by 
1/100  min.  and  new  computation  starts.  This  is  continued  until  all  elements 
have  been  assigned  to  n  stations.  The  solution  obtained  by  this  method  should 
not  be  claimed  as  optimal  but  is  usually  very  close  to  the  mathematically 
optimal  solution.  In  an  industrial  case  study  with  94  work  elements  a  balance 
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delay  of  0.75  per  cent  was  obtained.  As  will  be  clear  later  with  the  ranking 
by  positional  weights,  Klein's  [8]  shortest  route  method  could  also  be  used. 
III.  SHORTEST  ROUTE  MODEL 

Klein  [8]  has  shown  how  a  line  balancing  problem  can  be  formulated  as  an 
assignment  problem  or  as  a  shortest  route  problem  in  a  directed  network  when 
the  order  of  operations  is  specified.  He  suggests  that  the  more  general  pro¬ 
blem  can  be  handled  by  repeated  use  of  this  method  when  it  is  possible  to 
enumerate  all  feasible  ordering  of  operations. 

In  this  method,  assuming  the  given  ordering  is  1,2 . n  a  network  is 

constructed  with  n  +  1  nodes,  with  directed  arcs  (i,j)  where  i  ■  l,...,n; 
i<J;J“2,...,n  +  l  and  arc  distances  d^  -  a^  .  If  i  <_  j  and 

c  -  I,  “  t,  >  0  ,  then  a.,  is  the  idle  time  associated  with  a  station  to 
which  successive  operations  i  through  j  have  been  assigned.  In  all  other 
cases  a..  -  M  .  Arcs  that  are  with  a. .  -  M  or  those  with  indices  i  >  j 

lj 

are  not  drawn  in  the  network. 

In  this  network  every  arc  represents  a  possible  assignment  of  operations 
to  a  station  and  every  path  from  source  (1)  to  sink  (n  +  1) ,  a  possible  pro¬ 
duction  line  design.  Clearly  the  shortest  path  from  the  source  to  sink  gives 
the  solution  with  min.  m  delay.  The  shortest  route  problem  is  now  solved 
using  the  path  obtained  by  starting  at  the  source  and  going  to  its  closest 
node;  then  from  this  node  to  its  closest,  etc.,  until  the  sink  is  reached. 

The  major  drawback  of  Klein's  proposal  is  the  excessive  number  of  shor¬ 
test  routes  that  must  be  solved  to  solve  a  real-size  line  balancing  problem. 
Gutjahr  and  Nemhauser  [2]  used  a  similar  network  to  formulate  the  entire  line 
balancing  problem  as  a  single  shortest  route  problem.  Also  in  their  network 
it  is  sufficient  to  find  any  path  from  the  source  to  sink  containing  a  mini¬ 


mal  number  of  arcs. 
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They  define  a  'state*  as  a  partially  ordered  subset  of  B  which  is  a  col¬ 
lection  of  work  elements  that  can  be  processed  without  prior  completion  of 
any  other  work  elements  and  in  any  order  satisfying  p  .  Let  ,  i  =  0,  1,...,  r 
be  the  entire  collection  of  states  with  Cq  =  0  and  C  =  B  .  Each  state  has 
a  number  assigned  to  it  equal  to  the  sum  of  the  processing  times  of  work  ele¬ 
ments  in  the  state,  namely 

t  (Cq)  *  0  and  t  (C^)  *  ExeC^  t  (x)  i  *  1,...,  r 

A  directed  network  N  is  defined  using  states  (0,  1,  2,...,  r)  as  nodes, 
with  state  corresponding  to  node  i  .  In  N  there  is  a  directed  arc  (ij) 

from  nodes  i  to  j  if  and  only  if  C^C.  and  t  (C^ )  -  t  (C^  ^  c  and  each 
directed  arc  (ij)  has  a  distance  c  -  (t  (C  )  -  t  (C^)). 

It  is  clear  that  any  directed  path  from  0  to  r  represents  a  feasible 
assignment  of  all  work  assignments  and  the  number  of  arcs  the  number  of  stations 
in  the  assignment.  Also  the  length  of  the  path  represents  the  total  delay  time 
which  is  to  be  minimized. 


It  is  proved  that  for  given  c  the  expression  [5]  is  minimized  for  mini¬ 
mum  n  .  Hence  to  find  a  shortest  path  through  N  it  is  sufficient  to  find 
any  path  from  0  to  r  containing  minimal  number  of  arcs.  The  following  proce¬ 
dure  gives  such  a  path: 

"1.  Start  at  node  0  and  construct  all  arcs  (io)  from  it  such  that 


2. 


t  (Ci)  <.  c  .  The  nodes  reached  are  called  1st  nodes. 

Suppose  the  s-th  nodes  are  reached  for  the  first  time.  For  every 


node  among  the  s-th  node,  construct  an  arc  to  node  k  if  C^ClC^ 

and  t  (C,  )  -  t  (C. )  <.  c  .  Repeat  step  2  with  s  *  s+1  until  node  r 
K  J 

is  reached  for  the  first  time." 


The  method  is  quite  elegant  for  smaller  problems  but  with  an  increasing 


number  of  work  elements  and  flexibility  of  precedence  relations  the  'generation 
of  all  states'  itself  becomes  an  enumerative  problem  and  computation  on  time 
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lncreases  very  rapidly. 

IV.  CONCLUSION 

There  is  a  close  relation  between  the  above  method  [2]  and  the  dynamic 
programming  approaches  of  Jackson  [6]  and  Held  et  al  [3].  However  as  with 
usual  dynamic  programming  problems  the  computational  difficulties  multiply  as 
the  number  of  states  increases.  It  is  evident  that  any  method  for  line  bal¬ 
ancing  which  is  basically  enumeratlve  will  face  this  problem  of  computational 
hurdles  and  these  methods  may  not  be  economical  to  use  for  a  moderately  large 
problem,  though  the  method  of  Held  et  al  is  quite  powerful.  It  is  seen  that 
heuristic  approaches  as  of  Helgeson  and  Birnie  or  Mukherjee  and  Basu  still 
possess  certain  advantages  over  their  analytical  counterparts.  They  are  sim¬ 
pler,  less  time-consuming  and  give  a  resultant  balance-delay  which  is  small 
enough  for  any  practical  purpose.  Also  sensitivity  analysis  is  simplified. 

The  real  assembly  line  balancing  problem  is  further  involved  due  to  (a)  varia¬ 
tion  of  processing  times  from  cycle  to  cycle  and  from  operator  to  operator, 

(b)  error  in  measuring  or  estimating  processing  times  of  elements,  and  (c)  non¬ 
additivity  of  processing  times  for  work  elements  (i.e.,  +  tc  ^ 

t  +  tc  +  t^  if  performed  in  that  order).  Hence  further  refinement  of  balance 
at  increased  cost  is  often  undesirable.  It  seems  that  effort  should  be  direc¬ 
ted  to  include  these  other  features  of  the  line  balancing  problem  in  a  model. 
Such  a  model  will  be  much  more  realistic  so  that  we  can  definitely  say  that  the 
balance  achieved  on  paper  will  be  realized  in  practice  which  is  often  not  true 
for  the  models  available  now. 


tuztii 


ft 


-27- 


REFERENCES 


[1]  Foulkes,  I.D.,  "Directed  Graphs  and  Assembly  Schedules,"  Proc.  Symp. 

in  Appld.  Math.,  Vol  X,  281-289,  (1960). 

[2]  Gutjahr,  A.L.  and  Nemhauser,  G.L.,  "An  Algorithm  for  the  Line  Balan¬ 

cing  Problem,"  Mgt.  Sci. ,  11  (2),  308-  315,  (1964). 

[3]  Held,  M.  et  al,  "Assembly  Line  Balancing  -  Dynamic  Programming  with 

Precedence  Constraints,"  Opns.  Res.,  11  (3),  442-459,  (1963). 

[4]  Helgeson,  W.B.  and  Birnie,  D.P.,  "Assembly-Line  Balancing  Using  Ranked 

Positional  Weight  Technique,"  J.  Industr.  Engr.,  12  (6), 

394—,  (1961). 

[5]  Hu,  T.C.,  "Parallel  Sequencing  and  Assembly  Line  Problems,"  Opns.  Res., 

9  (6),  841-48,  (1961). 

[6]  Jackson,  J.R.,  "A  Computing  Procedure  for  a  Line-Balancing  Problem," 

Mgt.  Sci.,  2  (3),  (1956). 

[7]  Kilbridge,  M.D.,  and  Wester,  L.,  "A  Review  of  Analytical  Systems  of 

Line  Balancing,"  Opns.  Res.,  10,  626-638,  (1962). 

[8]  Klein,  M. ,  "On  Assembly  Line  Balancing,"  Opns.  Res.,  11  (2),  276-281, 

(1963). 

[9]  Moodie,  C.L.,  and  Young,  H.H.,  "A  Heuristic  Method  of  Assembly  Line 

Balancing  for  Assumptions  of  Constant  or  Variable  Work  Ele¬ 
ment  Times,"  J.  Indstr.  Engr.,  16  (1),  23-29,  (1965). 

[10]  Mukherjee,  S.K. ,  "A  Heuristic  Approach  of  Assembly-Line  Balancing," 

M.  Tech  Thesis,  Indian  Institute  of  Technology,  Kharagpur, 
India,  July  1962. 

[11]  Mukherjee,  S.K. ,  and  Basu,  S.K.,  "An  Application  of  Heuristic  Method 

of  Assembly  Line  Balancing  in  an  Indian  Industry,"  Proc. 

Inst,  of  Mech.  Engrs.,  London,  P  11/64,  (1964). 

Salveson,  M.E.,  "The  Assembly-Line  Balancing  Problem,"  Trans.  Amer.  Soc., 
Mech.  Engrs.,  77,  939,  (1955). 


[12] 


-28- 


SUMMARY  OF  KLEE'S  RESULTS  ON  BOUNDING  THE  NUMBER 
OF  SIMPLEX  CYCLES 
by  Bennett  Fox 


A  linear  program  is  nondegenerate  if  the  b  vector  cannot  be  expressed 
as  a  linear  combination  of  fewer  than  m  columns  of  the  m  x  n  constraint 
matrix  which  implies  that  no  b^  ever  vanishes.  We  assume  throughout  that 
we  start  with  a  feasible  vertex,  although  by  reinterpretation  of  "feasible" 
and  "optimal,"  the  results  apply  to  Phase  1  as  well  as  to  Phase  2.  Let 
LP(m,n)  be  the  class  of  nondegenerate  linear  programs  with  m  linear  equa¬ 
lity  constraints  and  n  (0  <m  <n)  non-negative  variables  (including  slacks). 

Using  a  coordinate-free,  geometric  approach,  Victor  Klee  [2]  shows  that 
there  exists  a  linear  program  in  LP(m,n)  and  a  feasible  starting  vertex 
such  that  m(n  -  m  -  1)  +  1  simplex  iterations  are  required  to  reach  the 
optimal  vertex  when  the  widely  used  steepest  descent  rule  determines  the  col¬ 
umn  to  enter  the  basis. 

No  numerical  examples  are  given  in  [2],  but  Phillip  Wolfe  [4]  has  given 
the  one  below  for  the  case  m  ■  1  : 


Max 


n-1 


l 

j-i 


x 


j 


3  •  t  • 


l  -1 

>1  3  n 


x  j  1  0  ,  j  ■  1, . . . ,  n  . 

The  "min  Cj"  rule  (steepest  descent)  pivots  on  x^,  X2»...,  x^_^  in  succes¬ 
sion.  Thus,  with  one  constraint,  we  can  go  through  every  possible  basis. 
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Klee  conjectures  that  m(n  -  m  -  1)  +  1  is  an  upper  bound  (necessarily 
sharp  when  using  steepest  descent)  on  the  number  of  simplex  iterations  tc 
reach  the  optimal  vertex  for  any  program  in  LP(m,n)  with  any  rule  for  in¬ 
troduction  of  new  basic  variables  that  decreases  the  value  of  the  objective 
function  at  each  stage  (i.e.,  the  pivot  columns  always  have  c^  <  0  ).  The 
conjecture  has  been  proved  [3]  only  for  n  <  m  +  4  .  This  bound  (if  correct) 
is  a  great  improvement  over  the  trivial  upper  bound 


(:) 


Comments: 

1.  The  proof  of  the  conjecture  for  n  <  m  +  4  seems  to  work  only  when 

the  feasible  region  is  bounded.  However  to  guarantee  that  this  holds 

n 

it  suffices  to  add  the  condition  E  x.  +  x.,  «k<®.  Here  x  , , 

j*l  i  n+1  n+1 

is  a  nonnegative  slack  variable  and  k  is  chosen  large  enough,  say 
30 

10  ,  such  that  if  the  constraint  ever  becomes  tight  we  will  assume 
that  the  objective  function  was  unbounded  from  below  in  the  original 
feasible  region.  The  conjectured  upper  bound  on  the  number  of  simplex 
cycles  is  now  (m  +  1)  (n  -  m  -  1)  +  1  . 

2.  By  perturbation  we  can  always  ensure  nondegeneracy.  However,  to  save 
time  all  existing  codes  omit  this  and  hence  with  these  codes  the  sharp 
upper  bound  on  the  number  of  simplex  cycles  is  00  ,  although  this  ap¬ 
parently  occurs  only  for  specially  constructed  pathological  examples. 

In  practice,  the  number  of  simplex  cycles  rarely  exceeds  3m  .  See  [1], 
Note  that  Klee’s  conjecture  applies  only  to  nondegenerate  programs. 
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MAtiSflii 


REVIEW: 

CYCLING  IN  THE  TRANSPORTATION  PROBLEM 

By  B.  J.  Gassner,  Naval  Research  Logistics  Quarterly ,  11,  43-58,  (1964). 

This  paper  contains  a  numerical  example  of  cycling  (circling)  in  a  4x4 
assignment  problem.  However,  to  construct  the  class  of  problems  from  which 
this  example  was  taken  required  the  use  of  rather  artificial  rules  for  adding 
and  dropping  basic  variables.  For  example,  in  going  from  cycle  2  to  cycle  3 
x^2  entered,  but  c^2  -  -4  whereas  c^2  ■  -2  .  Thus,  the  steepest  descent 
criterion  was  not  used. 

The  rule  for  choosing  the  variable  to  drop  in  case  of  ties  was  also  un¬ 
natural.  The  choice  must  be  such  that,  fixing  at  its  current  value  the  price 
on  the  row  where  the  new  basic  variable  is  to  enter,  only  nonnegative  (non¬ 
positive)  quantities  are  to  be  added  to  the  current  row  (column)  prices. 

The  3x3  assignment  problem,  under  a  very  special  hypothesis,  is 
shown  to  be  incapable  of  circling  when  the  drop  rule  described  above  is  used. 

—  Jq  k 

This  special  hypothesis  is  that  the  value  of  c^  ,  where  x^  is  to  en¬ 
ter  the  basis  on  the  (k  +  l)st  cycle,  is  the  same  for  all  k  .  Since  this 
condition  is  so  peculiar,  the  problem  should  be  considered  open. 


—  Bennett  Fox 
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RESEARCH  PROBLEMS 
by  George  B.  Dantzig 

The  following  is  a  list  of  eight  well-known  unsolved  problems  from  the 
field  of  mathematical  programming.  The  original  list  compiled  in  August  1962, 
contained  ten  problems,  two  of  which  have  since  been  solved. 

1.  Let  be  an  n-dimensional  bounded  polyhedral  convex  set  defined  by 

2n  distinct  faces  n  of  which  determine  the  extreme  point  p^  and  the  re¬ 
maining  n  of  which  determine  the  extreme  point  p^  .  Does  there  always  ex¬ 
ist  a  chain  of  edges  joining  p^  to  p2  such  that  the  number  of  edges  in 
the  chain  is  n  ? 


2.  Let  E  be  the  extreme  points  of  a  unit  n-cube  having  as  faces  the  coor¬ 
dinate  hyperplanes  through  the  origin  and  the  hyperplanes  parallel  to  them 
passing  through  the  point  (1,  1,...,  1).  Let  P  be  a  given  hyperplane  which 
separates  E  into  two  parts,  E^  and  E2  .  Characterize  the  n-1  dimen¬ 
sional  faces  of  the  convex  set  having  E^  as  its  complete  set  of  extreme 
points. 


3.  A  matrix  such  that  the  determinant  of  every  square  submatrix  has  value 
-1,  0,  or  +1  is  called  unimodular.  The  distinct  columns  of  such  a  matrix 
are  said  to  form  a  complete  set  if  the  annexation  of  a  column  not  in  the  set 
destroys  the  unimodular  property.  Two  such  sets  belong  to  the  scone  class  if 
one  can  be  obtained  from  the  other  by  a  permutation  of  the  rows  of  its  matrix. 
Characterize  the  various  classes.  How  can  they  be  generated?  Given  a  matrix, 
find  necessary  and  sufficient  condition  that  it  satisfy  the  unimodular  pro¬ 
perty. 


Given  an  n  x  n  permutation  matrix 


i.e.,  a  zero-one  matrix  each 


4. 


row  and  column  of  which  have  exactly  one  unit  element.  Let  the  set  of  its 
2  2 

n  elements  constitute  a  point  in  n  -dimensional  coordinate  space.  It  is  ' 
known  that  these  and  only  these  poinfs  are  extreme  points  of  the  convex  set 
defined  by 


n 

I  xjj  “1  j=l*2,...,n 

i-1 


n 


l 

J-l 


1 


i  *  1,2, ... ,n 


>  0 


It  is  not  known,  however,  how  to  characterize  the  faces  of  the  convex  polyhe¬ 
dral  sets  whose  extreme  points  consist  only  of  those  permutation  matrices  which 
represent  n-cycles. 


5.  If  a  square  matrix  M  has  k  nonzero  elements,  k  multiplications  and 
additions  are  required  to  multiply  M  by  an  arbitrary  vector  b  .  Its  in¬ 
verse  M  ^  ,  which  is  assumed  to  exist,  may  have  more  than  k  nonzero  ele¬ 
ments,  hence  may  require  more  than  k  of  each  of  these  operations  if  multi¬ 
plied  by  an  arbitrary  vector  b  .  However,  M  ^  may  be  represented  (in  fact, 
in  many  ways)  as  a  product  of  elementary  matrices  generated  by  row  and  column 
transformations  on  M  .  Prove  or  disprove  the  conjecture  that  there  always 
exists  a  representation  such  that  carrying  out  the  indicated  operations  with 
b  will  require  no  more  than  Z  -  k  multiplications  and  Z'  *  k  additions. 

If  not  true,  find  sharp  lower  bounds  for  Z  and  Z'  . 


6.  Given  an  n-dimensional  simplex  with  n-1  of  its  n  faces  fixed  and 


its  remaining  face  variable  but  parallel  to  a  given  hyperplane.  Find  the 
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largest  such  simplex  whose  interior  contains  no  lattice  point. 

7.  Geometrically,  the  simplex  method  moves  from  one  vertex  to  that  of  a 
neighboring  vertex  which  gives  the  greatest  change  in  the  value  of  the  linear 
form  (where  variables  correspond  to  the  coordinates  of  a  point).  For  convex 
sets  defined  by  m  equations  in  n  non-negative  variables,  the  number  of 
such  moves  is  remarkably  low  (often  between  m  and  n  in  practice).  Intui¬ 
tively,  wandering  on  the  outside  of  a  convex  set  in  this  manner  would  appear 
to  be  extremely  inefficient,  yet  empirical  evidence  from  thousands  of  cases 
is  to  the  contrary.  Why? 

8.  Usually,  there  is  an  analogue  for  linear  inequality  systems  of  a  theorem 
about  linear  equality  systems.  The  problem  of  minimizing  a  positive  definite 
quadratic  form  subject  to  linear  equation  constraints  is  reducible  (by  the 
method  of  Lagrange)  to  solving  a  certain  system  of  linear  equations.  If  the 
constraints  are  replaced  by  linear  inequalities,  is  the  entire  problem  redu¬ 
cible  to  that  of  solving  a  certain  system  of  linear  inequalities  (i.e.,  to  an 
equivalent  linear  program)? 
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Following  are  some  abstracts  of  dissertations  and  theses  submitted  to 
the  University  of  California  at  Berkeley  on  subjects  pertaining  to  Operations 
Research. 
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Multi-Stage  Programming  under  Uncertainty 

By 

Mostafa  Mohamed  Nabih  El-Agizy 


ABSTRACT 


This  Investigation  is  concerned  with  a  multi-stage  linear  programming 
problem  under  uncertainty.  The  model  considered  is  an  extension  to  the  two- 
stage  problem  first  formulated  by  Dantzig.  In  each  period  demand  is  a  ran¬ 
dom  variable  with  known  distribution  function.  The  problem  is  characterized 
by  decisions  made  sequentially  over  a  horizon  of  k  time  periods.  In  each 
period  to  make  the  best  possible  decision  one  must  use  the  observed  values 
of  the  random  parameters.  When  demand  has  a  discrete  distribution  we  have 
established  an  approach  that  reduces  the  multi-stage  problem  to  a  linear  pro¬ 
gram  with  upper  bounded  variables.  This  results  in  a  meaningful  reduction 
in  problem  size.  Even  so  the  latter  program  can  grow  very  large,  so  that  an 
additional  algorithm,  using  the  decomposition  principle,  is  proposed  as  a 
solution  technique. 

Several  special  cases  of  practical  importance  that  fit  in  this  formula¬ 
tion  are  considered: 

a-  A  transportation  model 

b-  A  production-inventory  model 

c-  A  Leontief  substitution  model  of  production 

d-  A  dynamic  inventory  model. 

For  the  two-stage  transportation  model  it  is  shown  that  the  corresponding 
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deterministic  equivalent  program  represents  a  directed  network.  For  the  two- 
stage  production-inventory  problem  we  show  that  the  equivalent  linear  program 
is  particularly  simple.  Moreover,  for  the  Leontief  production  model,  it  is 
shown  that  the  optimal  selection  of  alternative  substitute  activities  is  in¬ 
dependent  of  the  demand  distribution.  However,  the  above  results  do  not  seem 
to  extend  to  the  multistage  case.  Finally,  we  establish  that  the  dynamic 
inventory  problem  has  a  network  representation;  thus  network  flow  theory  can 
be  used  for  solving  this  class  of  problems. 
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An  Adaptive  Age  Replacement  Policy 

By 

Bennett  Fox 

ABSTRACT 


Under  an  age  replacement  policy  we  replace  at  failure  or  at  the  end  of 
a  specified  time  interval,  whichever  occurs  first.  This  makes  sense  if  a 
failure  replacement  costs  more  than  a  planned  replacement  and  the  failure 
rate  is  strictly  Increasing.  We  assume  that  the  failure  distribution  is  a 
Weibull  distribution  with  known  shape  parameter  (greater  than  one)  and  un¬ 
known  scale  parameter.  Moreover,  we  assume  that  a  natural  conjugate  prior 
distribution  with  specified  parameters  is  at  hand  which  we  modify  after  each 
stage  according  to  Bayes'  rule.  Our  policy  adapts  to  the  changing  prior. 

We  see  intuitively  that  the  larger  the  replacement  interval  set,  the  more 
information  we  are  likely  to  obtain.  We  take  account  of  this  in  a  precisely 
defined  manner  via  dynamic  programming.  The  optimal  policy  is  partially 
characterized  and  various  limiting  results  are  obtained. 
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Games  of  Sequence  Prediction 

By 

David  William  Matula 


ABSTRACT 


A  predictor  is  allowed  to  observe  a  sequence  indefinitely  and  must  pick 

some  point  at  which  he  believes  a  particular  subsequence  will  not  occur  next. 

In  order  to  insure  a  guaranteed  reliability  the  predictor  assumes  the  sequence 

is  generated  by  an  emittor  who  is  trying  to  have  this  subsequence  occur. 

We  show  that  if  the  subsequence  involved  has  a  "self  disjoint"  property, 

i.e.  it  does  not  overlap  with  itself,  and  is  composed  of  K  >_  2  characters, 

N  ^  2  of  which  are  distinct,  then  the  value  of  this  sequence  prediction  game 
K— 1  K 

is  (K-l)  /K  for  any  N  ;  the  emittor  has  an  encoding  strategy  that  as- 

K-l  K 

sures  passage  of  the  subsequence  with  probability  at  least  (K-l)  /K  against 

any  prediction  strategy;  and  the  predictor  has  a  strategy  which  limits  the  pro- 

K— 1  K 

bability  of  occurrence  of  the  subsequence  to  (K-l)  /K  +a  for  any  a>0  no 
matter  what  sequence  is  presented.  It  is  observed  that  for  long  "self  disjoint" 
subsequences  the  optimal  encoding  achieves  a  reliability  of  only  1/e  times 
the  return  which  could  be  achieved  against  a  random  prediction  strategy. 

Even  in  some  cases  where  the  subsequence  the  emittor  is  trying  to  pass 
has  a  relatively  simple  structure,  we  show  that  the  emittor' s  optimal  encoding 
strategy  can  require  an  "infinite  memory"  of  previously  emitted  characters. 

The  predictor's  a-optimal  strategies  require  only  a  finite  memory  which,  how¬ 
ever,  grows  as  a  approaches  zero. 
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Wildland  Fire  Control  with  Limited  Suppression  Forces 

By 

Alan  Wayne  McMasters 

ABSTRACT 


The  studies  of  Parks  and  Jewell  are  extended  to  the  problems  of  initial  attack 
allocation  of  limited  suppression  forces,  including  the  development  of  risk 
models  for  two-stage  programming  under  uncertainty  for  several  realistic  al¬ 
location  strategies  using  event-review  schedules.  The  strategies  allowing 
transfer  of  forces  between  fires  are  shown  to  be  better  than  those  allowing 
no  transfers. 

The  analyses  begin  with  the  development  of  a  deterministic  model  for  two  clas¬ 
ses  of  strategies  for  allocating  forces  to  a  new  fire;  those  where  reserves 
are  the  only  source  of  forces,  and  those  where  the  source  includes  both  re¬ 
serves  and  forces  assigned  to  existing  fires.  Allocation  policies  are  then 
derived  which  minimize  the  total  cost  of  all  fires  for  the  special  case  of  two 
non-slmultaneous  fires.  These  policies  are  used  in  the  development  of  two- 
stage  risk  models  which  is  then  used  to  determine  the  optimal  initial  attack 
force  to  assign  to  an  existing  fire  under  the  threat  of  additional  fires. 

The  salient  features  of  the  risk  models  are  illustrated  in  a  numerical  exam¬ 
ple  in  which  parametric  variation  of  several  parameters  allows  the  explanation 
of  a  large  region  of  possible  behavior  for  the  strategies.  The  size  of  the 
suppression  force  to  send  to  a  current  fire  is  shown  to  decrease  as  the  inter¬ 
fire  transportation  cost  increases.  The  general  strategies  allowing  transfer 
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of  forces  between  fires  are  shown  to  be  better  than  those  allowing  no  trans¬ 
fer  of  forces,  and,  as  is  expected,  the  total  expected  costs  are  shown  to 
increase  as  the  size  of  the  available  suppression  forces  decrease. 
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Stochastic  Wear  Processes 


i 

By 

» 

Richard  C.  Morey 


ABSTRACT 


A  new  class  of  non-decreasing  stochastic  processes  is  characterized. 
These  processes  satisfy  a  generalization  of  the  notion  of  an  increasing 
failure  rate.  From  physical  considerations,  these  processes  seem  suitable 
for  describing  the  process  of  cumulative  wear  or  damage.  The  main  inter¬ 
est  with  the  model  is  an  investigation  of  the  first  time  until  the  process 
exceeds  a  random  barrier. 

For  this  class  of  processes,  it  is  shown  that  the  first  passage  time 
random  variable  across  a  random  barrier  has  an  Increasing  failure  rate,  re¬ 
gardless  of  the  distribution  of  the  barrier.  In  addition,  by  the  use  of 
certain  intuitive,  non-parametrlc  assumptions,  tight  bounds  on  the  moments 
of  this  first  passage  time  random  variable  are  obtained. 
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Bounds  for  Lattice  Distributions  Having  Monotone 
Hazard  Rate  with  Applications 

By 

Gamanlal  P.  Shah 

University  of  California,  Berkeley 


ABSTRACT 


Using  methods  which  have  been  employed  for  obtaining  bounds  on  contin¬ 
uous  failure  distributions,  bounds  on  lattice  distributions  are  derived  un¬ 
der  the  increasing  (decreasing)  failure  rate  assumptions.  The  discrete 
bounds  are  convenient  in  a  number  of  applications  such  as  life  table  analy¬ 
sis  and  reliability  theory. 


-44- 


Mat  hemat  leal  Programming  and  Optimal  Control 

By 

Richard  Maurice  Van  Slyke 


ABSTRACT 

1D+1 

Let  K  be  a  closed  conved  set  in  E  and 

L  ■  (P  -  (Pn,...,P  )  :  P.  ■  P-  -  . . .  ■  P  -  0}  .  Then  for  the  simple  pro¬ 
wl  m  i  l  m 

blem: 

minimize  Pq 

subject  to  P  -  (Pn,P- , . . .  ,P  )  e  RflL  , 
we  prove  a  duality  theorem  and  the  convergence  of  a  solution  algorithm  mo¬ 
deled  on  the  duality  theorem  and  the  simplex  method  of  linear  programming 
respectively. 

Specialization  of  this  general  model  to  linear  programming,  convex  pro¬ 
gramming,  generalized  programming,  control  theory,  and  the  decomposition 
approach  to  mathematical  programming  yield  the  appropriate  duality  theorems 
and  solution  algorithms  in  each  case. 

The  principle  idea  exploited  here  is  the  notion  of  supporting  hyper¬ 
planes  to  convex  sets.  The  duality  theorem  is  a  direct  application  of  the 
fact  that  every  boundary  point  of  a  convex  set  belongs  to  a  supporting  hyper¬ 
plane;  moreover,  the  generalized  simplex  method  presented  here  is  most  use¬ 
ful  when  K  is  characterized  in  such  a  way  that,  given  a  hyperplane,  the 
translate  of  it  which  is  a  supporting  hyperplane  of  K  may  easily  be 
found,  if  it  exists,  as  well  as  the  points  of  the  supporting  hyperplane  which 


are  common  to  the  boundary  of  K  .  This  corresponds  to  "pricing  out"  in 
linear  programming. 

We  show  that  many  problems  in  control  theory  are  special  cases  of  our 
model  and  for  a  large  class  of  linear  control  problems  a  solution  method 
is  outlined  to  illustrate  the  use  of  mathematical  programming  techniques  to 
solve  optimal  control  problems. 

Two  appendices  contain  the  elements  of  the  theory  of  affine  spaces,  of 
convex  sets,  and  of  ordinary  differential  equations  used  in  the  text. 
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An  Inventory  Model  for  Rented  Equipment 

l 

By 

William  Donald  Whisler 

ABSTRACT 


An  Inventory  of  rented  equipment  is  studied.  Equipment  is  withdrawn 
from  the  Inventory  by  customers  who  use  it  for  a  length  of  time  and  then 
return  it.  Decisions  about  the  amount  of  equipment  to  rent  can  be  made  at 
certain  points  in  time.  This  dissertation  describes  a  policy  for  making 
these  decisions  which  minimizes  expected  costs. 

A  dynamic  programming  model  is  formulated  to  describe  the  problem.  The 
model  is  different  than  the  usual  ones  considered  in  the  literature  in  three 
respects.  First,  the  equipment  which  is  withdrawn  from  the  inventory  is  not 
consumed;  it  is  only  used  for  a  certain  length  of  time  then  it  returns  to  the 
inventory.  The  amount  of  equipment  in  the  inventory,  consequently,  can  fluc¬ 
tuate  up  or  down.  Second,  all  the  equipment  in  the  Inventory  is  rented.  Thus, 
when  a  decision  is  made  about  how  much  equipment  is  needed,  either  more  or 
le88  than  currently  is  on  hand  can  be  rented.  Third,  convexity  of  the  cost 
function  is  not  Important  because  simple  optimal  policies  can  be  found  when  the 
cost  function  is  nonconvex. 

The  exact  form  of  the  optimal  policy  depends  on  the  specific  assumptions 
made,  however,  all  of  the  optimal  policies  have  the  following  generic  struc¬ 
ture.  At  the  time  a  decision  is  to  be  made  two  numbers  t  and  u  ,  with 
t  <  u  ,  can  be  computed.  If  the  amount  of  equipment  currently  on  hand  is 
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greater  than  u  (less  than  t  )  then  it  is  optimal  to  rent  u(t)  .  If  the 
amount  of  equipment  is  in  between  t  and  u  then,  assuming  convexity,  it 
is  optimal  to  continue  renting  the  same  quantity  or,  assuming  nonconvexity, 
no  general  statement  can  be  made  about  what  to  do  because  for  each  number 
rented  in  between  t  and  u  there  may  be  a  different  optimal  number  to 


rent . 
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Sensitivity  Analysis  of  Networks 

By 

Richard  D.  Wollmer 

ABSTRACT 


This  Investigation  is  concerned  with  a  sensitivity  analysis  on  source- 
sink  planar  maximum  flow  networks.  Specifically  each  arc  of  the  network  is 
subject  to  breakdowns  which  result  in  a  reduction  in  its  capacity.  The  pro¬ 
blem  is  to  find  the  greatest  reduction  in  maximum  flow  possible  if  n  break¬ 
downs  occur  and  where  they  must  occur  for  this  to  happen. 

The  network  itself  is  defined  by  a  set  of  arcs  and  a  set  of  points  called 
nodes.  Each  arc  joins  two  nodes  and  has  associated  with  it  a  positive  capa¬ 
city  which  represents  the  maximum  amount  of  flow  that  may  pass  over  it.  One 
of  the  nodes  is  designated  as  the  source  and  another  as  the  sink.  These  nodes, 
arcs,  and  capacities  are  sufficient  to  determine  the  maximum  amount  of  flow 
that  may  pass  from  source  to  sink.  In  addition,  it  is  required  that  if  an  arc 
joining  the  source  to  the  sink  is  added,  the  new  network  may  be  drawn  on  a 
sphere  in  such  a  way  that  no  two  arcs  intersect  except  at  a  node. 

Two  cases  are  considered  for  the  sensitivity  analysis  problem.  In  the 
first  case  the  problem  is  solved  exactly  where  it  is  assumed  that  each  arc  is 
subject  to  one  breakdown  and  the  amount  by  which  the  capacity  of  an  arc  is 
reduced  due  to  a  breakdown  is  a  deterministic  quantity. 


In  the  second  case  the  problem  is  solved  approximately  where  multiple 
breakdowns  are  allowed  for  the  individual  arcs  but  the  amount  by  which  the 
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capacity  of  an  arc  is  reduced  due  to  breakdowns  is  a  random  variable  with 
unknown  distribution  but  with  known  mean  and  variance. 
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